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Abstract We analyze the dynamics of evolutionary games in which fitness 
is defined as an affinc function of the expected payoff and a constant contri- 
bution. The resulting inhomogeneous replicator equation has an homogeneous 
equivalent with modified payoffs. The affinc terms also influence the stochastic 
dynamics of a two-strategy Moran model of a finite population. We then ap- 
ply the affinc fitness function in a model for tumor-normal cell interactions to 
determine which are the most successful tumor strategies. In order to analyze 
the dynamics of concurrent strategics within a tumor population, we extend 
the model to a three-strategy game involving distinct tumor cell types as well 
as normal cells. In this model, interaction with normal cells, in combination 
with an increased constant fitness, is the most effective way of establishing a 
population of tumor cells in normal tissue. 
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1 Introduction 



Evolutionary dynamics describes changes in populations of competing individ- 
uals over time (Nowak 2006a). These changes depend on the notion of fitness, 
a quantity that describes how many offspring a member of the population is 
expected to produce. In the simplest model of fitness, the number of offspring 
depends only on the individual itself and not on other individuals or the en- 
vironment. More generally, fitness may be modeled as frequency-dependent, 
accounting for interactions among individuals. In evolutionary game theory, 
fitness is modeled as the outcome of a game whose players adopt distinct strate- 
gies; in this framework, individuals are identified with the strategy they play 
(Maynard Smith 1982 Hofbauer and Sigmund 2003 1 . The fitness assigned to 
a given strategy is typically defined as the expected payoff resulting from play- 
ing the game with all other strategies present in the population, and in this 
case, fitness is a linear function of the frequencies. Recently, nonlinear fitness 
functions have also been discussed (Taylor and Nowak' 2006; Priigel-Bennett 



1994 Altrock and Traulsen 2009 Traulsen et al 



2008,|2007j). 



An example of an evolving system is the cell population of a tumor. Tu- 
mors arise from normal cells in an organism through mutations that increase 
their somatic fitness, which leads to outgrowth of normal tissue by the tumor 



and eventually to invasion of other organs (Cairns, 1975 Nowell 1976). The 



increased proliferation of cancer cells is, in part, due to interactions with nor- 
mal cells (Axelrod et al. 2006). One example of tumor-stroma interactions 



is vascular endothelial growth factor (VEGF) signaling (Mueller and Fusenig 



2004). Many tumors secrete the mobile growth factor VEGF which stimulates 



the production of blood vessels. Angiogenesis, in turn, increases the fitness of 
tumor cells through the supply with nutrients and oxygen. Using experimental 
and bioinformatics methods, it has recently been estimated that cancer cells 
make up only 49% of the cells in tumor tissue (Van Loo et al. 2010 ). The sur- 
prisingly high fraction of normal cells in a tumor indicates that normal cells 
play an important role in tumor development. However, it remains elusive to 
which extent the interaction between normal and tumor cells may contribute 
to the proliferative advantage of tumor cells. 

To quantify the somatic evolution of tumors mathematical models are used 



(Michor et al. 2004). Approaches include population genetics models (Beeren- 



winkel et al.[ |2007| [Purrett et al.| [20091 [Gerstung and Beerenwinkel[ |2010 



Bozic et al. [2010 1 that describe the accumulation of driver mutations which 



confer a fitness advantage to the tumor cells, and evolutionary game theory 
models ( Basanta and Deutsch 2008 1 . Game-theoretic approaches were used to 



describe both interactions of tumor cells with the environment ( Gatenby and 



Vincent 2003) as well as among tumor cells (Tomlinson 1997). Interactions 



are not restricted to be pairwise. For example, Dingli et al. (20091 recently 
analyzed the joint interactions of multiple myeloma cells with osteoclast and 
osteoblast cells in the framework of evolutionary games. 

In the present work, we model fitness to be composed both of a game- 
theoretic interaction term and a constant term specific to each cell type. This 
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choice is motivated by the fact that cancer ceUs harbor muhiple mutations, 
which can affect cell-cell interactions, alter intrinsic behavior, or both. Hence, 
the fitness function is an affine function of the relative frequencies of normal 
and tumor cells. 

We first analyze the evolutionary dynamics in general in the framework of 
the replicator equation. Specifically, we clarify the role of the interaction term 
relative to the constant fitness term. We show that the Prisoner's Dilemma 
game, which does not allow for the evolution of cooperation, is transformed 
by adding a constant fitness term in such a way that cooperation becomes 
possible for certain parameter choices of the affine fitness function. We also 
analyze how the affine fitness terms affect the stability criteria for a Moran 
model of a two-strategy game in a finite population. 

The results for the continuous replicator model are then applied to assess 
whether exploitation of normal cells or intrinsic proliferation is more evolution- 
arily favorable for a tumor cell. We analyze a set of tumor strategies leading 
to the same equilibrium with normal cells in a pairwisc game, and find that 
the strategy with both a constant fitness advantage and attraction of normal 
cells is most successful in the competition with other tumor strategies. 



2 Inhomogeneous evolutionary games in infinite populations 

We consider a game with n strategies and payoff matrix M E M"^". The 
entry mjj of M denotes the payoff to strategy i if playing against strategy j. 
In evolutionary game theory, a fixed strategy is associated to each individual. 
In our application, we think of the strategy as being determined by the genetic 
changes of the cancer cell and we identify strategies with genotypes and with 
cell types. We first assume an infinite population size and describe the state 
of the population by the vector 

xe5„_i = |xe[0,l]"| fja;i = l| (1) 

of relative strategy frequencies. The state space Sn-i is the (n— l)-dimensional 
probability simplex. The fitness of a type i individual is the expected payoff 

n 

M^) = J2^ijXj- (2) 

i=i 

Let us assume now that fitness is composed of such a linear term arising from 
a game plus a constant term G M. In vector notation, the resulting affine 
fitness function is 

/(x) = Mx + r (3) 

where r G M". For r = (0, . . . , 0)^, we recover the strong selection limit, where 
fitness is directly given by the expected payoff of the game. For w G R+, w <^1, 
and r = {1 — w, . . . ,1 — w)^, the affine fitness function can be interpreted as 
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that of the game with payoff M' := {l/w)M in the weak selection hmit: 
/(x) = wTVf'x + (1 — w, . . . , 1 — w)^ . In both hmiting cases, all components 
of the constant term r are identical. In the following, we relax this constraint 
and allow the components to be different for each strategy. 

For infinite population size, the dynamics of reproducing individuals can 



be described by the replicator equation (Taylor and Jonker 1978 Zeeman 



1980 Schuster and Sigmund 1983 ) as 



[/i(x) - ^(x)] , i = 1, 



(4) 



where 0(x) = x^/(x) is the average fitness of the population. The fixed points 
of this system are the solutions of the set of algebraic equations x = 0. The 
replicator equation always has the n trivial solutions x* given by x* = 1 and 
X* = 0, for all j ^ i. Hofbauer and Sigmund ( 1998 1 provide a general proof 



for the possible number ot internal equilibria in two-player, n-strategy games. 
A more general system is considered in Gokhale and Traulsen] ( j2010J . 

For the affine fitness function defined in Eq. [3j the replicator equation [4] 
is said to be inhomogeneous. The inhomogeneous replicator equation can be 
interpreted as the (homogeneous) replicator equation of a transformed game. 



Theorem 1 (Stadler, 1991) The inhomogeneous replicator equation with 



affine fitness function /(x) = A/x + r is equivalent to the homogeneous repli- 
cator equation with linear fitness function /'(x) = M'x with 



Proof Because X]?=i ~ 1, one has 



(5) 



(6) 



It follows that (t)'{x) = X /'(x) = <p{x). Hence we have /i(x) — (f>(x) — f[{s.) — 
0'(x), which completes the proof. 

Theorem 1 shows that the replicator dynamics induced by an affine fitness 
function can be obtained from an equivalent homogeneous replicator equa- 
tion. However the evolutionary dynamics of the transformed game M' can be 
substantially different from the one based on M alone. 



3 Two-player games in infinite populations 

Passing from a linear to an affine fitness function by adding a constant fitness 
term shifts the equilibrium of the replicator equation. We consider the inho- 
mogeneous replicator equation for two types of individuals (strategies) A and 
B with 

A B 




Evolutionary Games with Afiine Fitness Functions: Applications to Cancer 



5 



Behavior 


Schematic 


Parameter Range 


Stable internal equilibrium 


A ^ X* 


^ B 


a < a < l3 


Unstable internal equilibrium 


A x* 


B 


a> a > P 


A dominates B 


Ai — 


B 


a < a,l3 


B dominates A 


A — > 


B 


a > a,l3 



Table 1 Stability of the 2-strategy replicator equation with afBnc fitness function with 
game M and offset r, Eq. [7] Parameters are as in Eq. [S] Arrows indicate the change in the 
composition of the population over time. 



By Theorem 1, there exists a non-trivial fixed point in which the proportion 
of A individuals in the population is given by 

X = , (8) 

p ~ a 

where we have defined a ~ a ^ c, /3 — b — d, and a — t — s. The fixed point x* 
is attractive and in (0, 1) if and only if 

a < a < l3, (9) 

that is, if the difference in constant fitness a is between the differences in 
payoff a and /3. It follows that for any game with a < /3 there exist constant 
fitness contributions r such that a satisfies ^ and x* is a stable, non-trivial 
equilibrium point. 

Apart from the stable equilibrium, dominance of A (denoted by i? — > A) , 
dominance of i? {A ^ B), and an unstable equilibrium at x* are possible. The 
parameter regimes leading to these dynamics are summarized in Table [T] 



3.1 The Prisoner's Dilemma 



The Prisoner's Dilemma is a metaphor for the evolution of cooperation (Ax- 



elrod and Hamilton 1981 ). This game is defined by the inequalities 

b < d < a < c (10) 

Strategy A is called cooperation and denoted C, whereas strategy B is called 
defection and denoted D. The inequalities imply that a,/3 < 0. For linear 
fitness functions, the non-trivial fixed point x* lies outside of the unit interval; 
thus xa = 0, xb = 1 is the only attractive fixed point and cooperation cannot 
evolve in this model. 

For affine fitness functions, however, there does exist a stable equilibrium 
between cooperators and defectors provided that a < cr < /3, as shown in the 
previous section (Figure [T]). The necessary condition a < (3 does not hold for 
all Prisoner's Dilemma games. If /? < a, then there exists only an unstable 
fixed point in (0, 1) (Figurejl]). In both cases, the all-cooperator equilibrium is 
stable, since a < f3. It is unique if in addition a < min{a, /?}. In this regime, 
constant selection dominates the dynamics of the evolutionary game, always 
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Fig. 1 Prisoner's Dilemma game with constant fitness advantage a of tfie cooperators. 
The solid black lines denote the frequency of cooperators Xq at the stable fixed point 
X* = {xq,x'^)^ as a function of a = t — s. Dashed lines are unstable fixed points. For 
a < (5, there exists a stable equilibrium (left, grey area) if o < ct < /3. For /3 < o, the 
internal fixed point at /3 < cr < o is unstable (right plot). For the homogeneous Prisoner's 
Dilemma, cr = 0, defection is always stable. 



favouring cooperators over defectors. Conversely, if u > a, there exists a stable 
all-defectors equilibrium, which is unique if in addition a > maxja, /?}. 

The Prisoner's Dilemma has been studied in many variations in order to 
derive conditions under which cooperation can evolve. For example, |Nowak| 



( 2006a ) listed five rules for the evolution of cooperation. To formulate and to 
compare these rules, often a simplified version of the Prisoner's Dilemma is 
considered, where a cost c is paid for cooperation, of which other cells receive a 
benefit b. Defectors do not pay a cost, and other cells do not receive a benefit 
from defectors: 



^=n('\' n) (11) 



C D 
1 — c — ( 
D \ b 

We consider the affine fitness function obtained from this simplified Prisoner's 
Dilemma game plus a constant fitness term. Because a = /3 — —c, the repli- 
cator dynamics do not allow for stable coexistence between cooperators and 
defectors. However, both pure strategies can be stable, namely cooperation for 
cr < — c, or equivalently, 

t-s>c (12) 

and defection otherwise (Figure [T]) . Hence, selection favors cooperators if the 
constant fitness advantage is higher than the cost to pay for cooperation. 
This rule for the evolution of cooperation makes precise the tradeoff between 
constant fitness contributions and those resulting from playing the Prisoner's 
Dilemma game. 
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4 Inhomogeneous two-player games in finite populations 

The deterministic replicator equation describes the dynamics of infinite pop- 
ulations. In finite populations a stochastic description in which interactions 
between members of the population are considered individually is more ap- 
propriate. 

We consider a finite population of constant size N, containing as before 
two types of individuals (strategies) A and B. M and r are defined as in Eq.[7] 
Let i denote the number of A individuals in the population, and denote by Fi 
and Gi the sum of the expected game payoff and the constant fitness term for 
types A and B respectively. We have 

i^-l)a + {N- i)b (^ - I)(q + s) + {N - i){b + s) 

N -I N -I ^ ' 

_ ic+{N-i-l)d _ i{c + t) + {N -i-l){d + t) 

^^1 A^^l ■ ^^^> 

Also for a finite population the entries of M may be transformed according 
to Eq. [5] to an equivalent homogeneous game M' . Yet the resulting changes 
of the stochastic dynamics in a finite population differ from those that arise 
in an infinite population. In the following, we discuss three different measures 
for the evolutionary success of a strategy in a finite population and study how 
these are affected by the constant fitness terms. 



Following [Nowak et al. (2004), we say that A resists invasion by B, or that 
A is an evolutionarily stable strategy (ESSat), if G^^i < F^^i, i.e., if one 
B individual in an otherwise al\-A population has lower fitness than the B 
individuals. This condition may equivalently be written as 

(iV- I)(a-CT) > a-6, (15) 

where a ~ t ~ s, as above. Note that for N 00, this condition is equivalent 
to a < a, from which it follows that xj^ = is an unstable fixed point of 
the replicator equation (Table [l]). Similarly, one obtains that B is ESSat if 
Fn-1 > Gjv-i, or 

(7V-I)(/3-cr) <c-d, (16) 
which is for large A'' again equivalent to u < /3. 



The Moran process (Moran 1962) provides one model for evolutionary 



dynamics in finite populations. In each step of the process, one individual is 
chosen to reproduce with probability proportional to its fitness; its offspring 
replaces another individual, chosen at random from the population. Denote by 
Pij the probability that given i A individuals, one step of the process yields 
j A individuals. We have 

_ ifi N~i 

" w+w^. ■ ^ ' 

ifi + {N - i)g, N 

PiA = 1 — PiJ + l — PiA-1, (19) 
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and Pi,j — otherwise. To compute the fixation probabihties in the presence 



of an aiEne fitness term, we consider the Umit of weak selection ( 


Taylor et al. 


2004 


Antal and Scheuring 2006 


Lessard and Ladret 


2007 


Wu et al. 


20101. 



We define the frequency-dependent fitness for types A and B, respectively, by 

f,^l-w + wF, (20) 
= l-w + wG„ (21) 

where the parameter w G (0,1) defines the intensity of selection. Small values 
of w indicate near-neutral evolutionary pressure ( Kimura 1985 Ohta 2002 ) 



The fixation probability of type A, i.e., the probability that one A indi- 



PA = [i 

For small w a power series expansion yields 



Karlin and Taylor 


1975 


Taylor et al. 


2004 



PA 



1 

N 



1 - w {{xN -y)/6-{N - l)cr/2) ' 



(22) 



where a; = a + 26-c-2d = a + 2/3 and j/ = 2a + 6 + c-4d ( |Nowak[ |2006a |. 
Further details about the convergence of the weak selection limit can be found 
in |Wuet al.] ( |20T0| . 

For an A mutant with no fitness advantage over B, we have = 1/A^. We 
say A is advantageous (AD), if selection favors the fixation of A, pA > 1/-/V, 
or equivalently 

xN-y-3{N-l)a>0. (23) 

For large N, this becomes 

2/3 



a < 



(24) 



Hence this condition is fulfilled if the condition a < a, f3 for the replicator 
equation holds. Equilibrium is reached when Fi — Gi, or equivalently 



(T 

a 



(25) 



in agreement with the continuous case, Eq. |8] 

Lastly, we say A is risk-dominant (RD) over _B if > pB- In the case of 
weak selection, this is equivalent to 



a + P 



N -6{a-d) - {N -l)a > 0. 



(26) 



For large N, A is RD if, and only if 

a + (3 



CT > 



(27) 



holds. The criteria for AD, ESSat, and RD are summarized in Table [2] Note 
that all are fulfilled if ct < a, as required for A to be evolutionarily stable in 
the replicator equation. 
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Criterion 


Small population 


Large population 


ESSiv 


(N - 1)(q -a) <a-b 


a < a 


AD 


xN -y- 3{N - 1)ct > 


a < (a + 2/3)/3 


RD 


(a + f3)N/2 - 6(a - d) - (TV - 1)(t > 


a < (a + /3)/2 



Table 2 Criteria for the evolutionary stability of strategy A in finite populations of small 
and large size. 



As N grows large it is also possible to compute the expected time until 
fixation. As shown by Antal and Scheming (2006), the fixation time for an 
AD strategy starting from a single mutant scales like A^lnA^, whereas that 
of a neutral strategy scales like N"^. The affine modification affects whether a 
strategy is advantageous but not the scaling of the fixation time. 



4.1 Affine Prisoner's Dilemma in finite populations 

We return to the affine modification of the Prisoner's Dilemma defined in 



Eq. 11 considering it now in a finite population of size N. We have 



iV ■ l + f((A^-l)(a + c)-b)' ^^^^ 
Cooperation is AD, pc > 1/-/V, if 

-->c-^. (29) 

That is, the constant fitness advantage —a must be larger than the cost of 
cooperation c minus the benefit b divided by the population size minus one. 
It thus appears that the fixation probability of cooperators is higher in small 
populations, than in large ones. For N ^ oo condition Eq.[29]results in —a > c, 
again in agreement with the continuous case. 

Because we have a = — c = /3, the conditions for ESSa? and RD are equiv- 
alent to —a > c. For a = 0, cooperation satisfies none of the criteria for evo- 
lutionary success. However, in the affine case, each such criterion is fulfilled if 
the constant fitness advantage —a is higher than the cost c. Thus cooperation 
can also arise in small populations if cooperators can compensate the cost of 
cooperation by a constant fitness surplus. 



5 Coevolution of tumor and normal cells 



Tumors present an example of the evolution of defection, because cancer cells 



have lost their normal cooperative behavior and defect the host ( Michor et al. 



2004). However, experiments indicate that tumors consist of about 50% of non- 



cancerous cells. This fraction appears to be consistent among distinct cancer 



subtypes (Van Loo et al. 2010), which raises the possibility that the normal 
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cells are not the result of a random admixture, but constitute an attractive 
equilibrium resulting from interactions of tumor and normal cells. 

As shown in section [3j the two-player dynamics only depends on the dif- 
ference a and /3, as well as a. For a given attractive equilibrium, there exist 
thus many parameter combinations. In the following, we set x* — (1/2, 1/2), 
whic h is reasonably close t o the experimentally observed ratio of 49% tumor 



cells (Van Loo et al. 2010). We observe that this choice implies a = ^{a + P), 
which reduces the number of independent parameters to two. 

To explore the range of possible parameter combinations, we define the 
following three tumor cell strategies to be played against a normal cell type: 

Ti : ai = -l ^1 = 1 (Ti = 

T2 : a2 = -2 ^2 = = -I (30) 
23 : ag = ^3 = 2 = I 

When played pairwise against normal cells all three strategies lead to a sta- 
ble equilibrium at = 1/2. Tumor strategy Ti presents a mixed strategy 
of exploitation and attraction of normal cells, without an additional intrinsic 
fitness advantage. T2 is a strategy that strongly exploits (Prisoner's Dilemma), 
however at a the cost of a disadvantage in terms of the constant fitness con- 
tribution. T3 is a mixed strategy that has both a constant fitness advantage 
and the ability to recruit healthy cells. 



5.1 Three-player games 

In large tumors a huge genetic diversity is generated due to the large number 



of cells and a potentially increased mutation rate ( Beerenwinkel et al. 2007 



Bozic et al. 2010). It is thus likely that many different tumor cell types with 
specific strategies are present in the tumor simultaneously. Hence a strategy 
able to dominate many others will be successful in taking over a tumor. 

Let H denote the normal (healthy) cell type and Ti a tumor strategy. 
Again there is an affine payoff function for the tumor-normal interaction with 
the payoff matrix M and constant fitness r. Now consider a second tumor 
strategy T2. Assuming no interactions among the tumor cell types, the payoff 
matrix and fitness vector for the three strategies are 



H 


Ti 


T2 


a 


bi 


b2 


Cl 


di 





C2 





d2 



M = Ti Cl di , r = Ui . (31) 

T2 \C2 d2j \t2j 

According to Theorem 1 the affine fitness function can be rewritten in terms 
of the game 




M' = Ti -ai + cTi -/3i + ai -62 + , (32) 
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where the first row has been subtracted from all rows to obtain a representation 
in terms of a^, /3i, and (Ti, i = 1,2. Interestingly, the constant fitness terms 
lead to an effective interaction term among the tumor strategies. Moreover, 
the interactions, ^ = —61 + (72 and mip rp = —62 + ci, depend on the 
absolute value of bi and 62, i-c, on the payoff that a tumor pays to the fitness 
of normal cells. 

We now investigate the replicator dynamics for the transformed game de- 
fined in Eq. 32 and the tumor strategies defined in Eq. [30j following |Hofbauer| 
and Sigmund (19981; Bomze (19831. One has ai — (Ti = —1, and f3i — at = 1, 

b2 



i = 1, . . . ,3. We also assume that 61 = 
into the parameters /3i. It follows that 





H Ti 


T2 




f 







1 -1 


—b — (7i 


5 


[l -5 - (72 


-1 



6, any difference can be subsumed 



(33) 



This game has the non-trivial fixed points x* = (1/2, 1/2,0)''', and x* = 
(1/2, 0, 1/2)^. However, it depends on the parameter b whether these are stable 
or saddle points. As shown in Appendix A, there exists an additional fixed 
point in the interior of S2 at 



X* = {LOl,UJ2,i^3)^ /UJ 



(34) 



ith 



= 1 - (6 - (7i)(6 - CT2) 

W2 = 1 - (& - (7i) 

= 1 - (& - (72), 

and Lo = X^'-^ij if; ^"^^ only if, all uJi have the same sign, sgnoji 
sgnws (Stadler and Schuster 19901. 



(35) 



sgn UJ2 



The dynamic behavior of all three player games HTiTj of the normal cell 
type with two of the tumor strategies Ti, T2, and T3 can be divided into the 
following four cases: 

(i) For 



b < 



f7l -I- (72 



0-1 



- (1 - (71(72) 



(36) 



the normal cell type goes extinct. There exist only a stable equilibrium of 
the two tumor strategies. In this case the constant fitness advantages of 
both tumor types are so large that despite the payoff b to the normal cell 
type, H dies out. 
In the regime 



<Jl + (72 



(7i + (72 



- (1 - (7i(72) < 6 < 1 + min{(7i, (72} (37) 
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{i)fe = -2 H (ii)6 = -l H (m)f)=l H (iv)fe = 2 H 




> b 

Fig. 2 Illustration of the dynamic regimes (i)— (iv). Specific values are for the game NT1T2 
for different values of the parameter b. Red circles denote unstable fixed points, yellow 
triangles are saddle points, and green squares are stable equilibria. For case (iii), the fixed 
point on the edge AT^ for the tumor strategy with 0-^ > dj is stable. 



there exists a stable fixed point in the interior of the simplex. Hence all 
three cell types coexist. In this regime the constant fitness advantage of 
both tumor types are smaller than the fitness but not too large to have the 
normal cell type go extinct, 
(in) If 

1 + min{(Ti, 0-2} < 5 < 1 + maxjcri, (72} (38) 

there exists no interior fixed point. Then only the fixed point xh = 1/2, 
XTi — 1/2, for ai > aj is stable. That is, the tumor strategy that has 
the larger fitness advantage will win. Equivalently, we can write min{ii — 
s,t2 — s} < b — 1 < max{ii — s,t2 — s}. In this case, the constant fitness 
advantage of one tumor type is smaller than the payoff b minus 1, whereas 
the other tumor types' fitness advantage exceeds this value, 
(iv) Lastly, for 

b > 1 + maxjcTi, 0-2} (39) 

there exists an interior saddle point and both fixed points at the edges, x* — 
(1/2,1/2,0)^, and x* = (1/2,0, 1/2)T are stable. Which tumor strategy 
wins, depends on which of the two tumor strategies emerged first. The 
condition is equivalent to 6 > 1 + max{ti, ^2} — s. In this regime, the payoff 
to a normal cell b is larger than the constant fitness advantages to both 
tumor types plus one. Therefore, both tumor types attract normal cells 
more strongly than their constant fitness advantage. 

The dynamics associated with each case are illustrated in Figure [2] These 
different cases are realized for each game at different parameter values of b. 
For 6 = 2 (Figure [3]A_), we have case (vi) for the game HT1T2, and case (iii) for 
games HT1T3, HT2T3. Thus for HT1T2, whichever of the strategies Ti and T2 
arises first will be successful and converges to an equilibrium with H. In the 
other two games, however strategy T3 wins over Ti, and T2, respectively. We 
thus conclude that T3 is most successful. The coordinates of the equilibrium 
interior equilibrium x* defined in Eq. [34] are depicted in Figure [3p for the 
three games HT1T2, HT1T3, and HT2T3 as a function of the parameter b. 

Because tumor strategy T3 has the largest constant fitness advantage, 
(73 > <Ti > (72, it outcompetes the other tumor strategies for most values 
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Fig. 3 A-C: Tumor strategies in the 3 player case for b = 2,0,-1. Arrows denote the 
direction, and colors the rate of change defined by the replicator equation, Eq. |4] Points 
label the fixed points of the system, obtained by solving the algebraic equation defined by 
X = 0. Red circles are repelling fixed points (two real parts of the eigenvalues A;, i = 1, ... 3, 
of the Jacobian J{x*) positive), yellow triangles: saddle points (1 real part positive), and 
green squares are stable fixed points with two real parts negative. D: Position and stability 
of the interior fixed point as a function of b for all three games. Again yellow dots denote 
saddle points, green circles are stable fixed points. 
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of b. If b is of moderate size, there exists an equilibrium with Ti (Figure [3j3). 
The equihbrium level lies, however, at low frequencies of Ti. There also exists a 
stable equilibrium with T2 for 6 < (Figure[3p). Yet the latter appears biolog- 
ically unrealistic, as it would effectively repel normal cells, which contradicts 
the consensus of a positive interaction (jMueller and Fusenig 2004 ) . 

Tumor strategy Ti , which both exploits and attracts normal cells, wins over 
T2 for 6 > 0. This is because of the fitness disadvantage of T2. In comparison 
with T3, there is a bistable equilibrium for b > 2. For < 6 < 2, however, T3 
dominates 

The afhne Prisoner's Dilemma strategy T2 performs worst of all, because 
it has a fitness disadvantage compared to normal cells, in contrast to the 
other two tumor strategies. This disadvantage is required to generate a stable 
equilibrium with normal cells. Due to this disadvantage, however, the strategy 
is easily outcompeted by Ti and T3. 



6 Discussion 



In evolutionary games with affine fitness functions, the corresponding inhomo- 
geneous replicator equation has an equivalent homogeneous replicator equa- 
tion with a transformed game. The transformations of the game, however, can 
cause substantial differences as compared to the original game. For n = 2 
dimensions, the resulting changes can be fully characterized in terms of the 
constant fitness difference a. The affine transformations of the payoff matrix 
also influence the stochastic Moran model of a finite population, and we have 
evaluated how different criteria for the stability of a strategy are affected. 
The affine terms also alter the dynamics of the Prisoner's Dilemma game, a 



prototype game for studying the evolution of cooperation ( Axelrod and HamiL 



ton 



1981). In the presence of a constant fitness advantage, cooperation can 



arise if the fitness advantage is higher than the cost to pay for cooperation. This 
simple rule adds to the five rules for the evolution of cooperation that were 



presented recently (Nowak 2006b I. It makes precise the intuitive idea that 



cooperators can evolve if they compensate their disadvantage in the game by 
an intrinsic fitness contribution. 

In mathematical and computational models of cancer, reviewed recently 
by Attolini and Michor (2009), evolutionary game theory provides a useful 



tool for analyzing the role of cell differentiation and heterogeneity in tumor 
initiation and progression. In the earliest studies applying evolutionary game 
theory to cancer, Tomlinson and Bodmer investigated the effects on tumor 
progression of several cell behaviors, including cytotoxicity, angiogenesis, and 



apoptosis (Tomlinson 1997 Tomlinson and Bodmer 1997). Further studies 



have used evolutionary game theory to model spatial dynamics (Bach et al 



2003), tumor-host interaction (Gatenby and Vincent 2003), and the interac- 



tion of multiple tumor cell phenotypes (Bach et al. 2001 ), in particular those 



of invasive or motile cells ( Mansury et al. 2006 Basanta and Deutsch 2008 



Basanta et al. 2008). In the present study, we take explicit account of the 
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effects of affine transformations on evolutionary games in cancer, and we use 
this framework to investigate interactions among cell types within the tumor 
population. 

Tumor cells present an example where defecting strategies arise in an organ- 
ism of cooperating cells. Experimental data indicates that tumor cells exist in a 
stable equilibrium with normal cells (Van Loo et al. , 2010). We have therefore 
analyzed what type of tumor strategies would lead to such coexisting states by 
means of an inhomogeneous replicator equation. Fitness is modeled to contain 
both a game-theoretic and a constant term. Because most parameters of the 
model cannot be directly obtained by experiment, we assessed three different 
prototype tumor strategies leading to the same equilibrium level. To get fur- 
ther insight into the relative contributions of both the interactions with normal 
cells, and the intrinsic tumor-specific fitness, we have analyzed the dynamics 
of multiple tumor strategies. This approach is motivated by the finding that 
in large populations, new cell types arise quickly through spontaneous muta- 
tions. It is thus a requirement for a winning strategy to be able to compete 
with many others, although many of them are likely to exist only in very low 
frequencies. 

The analysis of multiple tumor strategies in a three player game shows that 
the affine fitness function introduces correction terms that cause an effective 
interaction of the tumor cells. The strength of these interaction terms was 
given by the constant fitness advantage, and the absolute payoff of tumor to 
normal cells. We have then classified the dynamics of the system based on the 
payoff to normal cells and the constant fitness advantage. We find that the 
most successful tumor strategy has both a constant fitness advantage and a 
payoff to normal cells (relative to the payoff to itself). 

The payoff to normal cells could be mediated by a mobile growth factor 
such as VEGF. This growth factors is secreted by tumor cells to attract blood 



vessels that, in turn, supply the tumor with nutrients (Mueller and Fusenig 



2004). Interestingly, the interaction through VEGF is also a target for drug 



interventions yet with ambivalent success (Garmeliet 2005). Our analysis also 
elucidates when such an intervention would be successful: In the replicator 
dynamics, an equilibrium between tumor and normal cells exists only if a — c < 
t — s < b — d. A therapeutic success would occur if normal cells dominate the 
dynamics. This requires a — c and 6 — d to be larger than t — s. An VEGF 
inhibitor would reduce the parameter 6, ideally to zero. This is however, not 
sufficient for the replicator dynamics to favour normal cells, because also a — c 
must become larger than t — s. A successful therapy must additionally reduce c 
to zero such that s < a. However, this may be difficult, or even impossible, 
to achieve for tumor cells with a high constant fitness advantage. 

In our model of tumor-normal interactions, all strategies were given. In 
cancer, however, new strategies are thought to arise through mutations. In the 
future it could thus be an interesting extension to the model to include mu- 



tations that transform one strategy into another, see for example (Fudenberg 



et al. , 2006 1 for a general analysis of evolutionary game theory with mutations 



in finite populations. Such an extension may also be capable of assessing the 
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interactions with cancer stem cells, which are hypothesized to form a distinct 



tumor subpopulation that replenishes normal tumor cells (Wicha et al. 
2006) . 



Clarke et al. 



2006 



A Fixed points of three player strategies 



Rewrite matrix M' of Eg. |32| in normal form: 

Ti 



M' : 



N 
Ti 

T2 



N 




-ai - 
-a2 - 



' (72 



/3i - 



/9i -<7i 


6l — 0"1 + CT2 



T2 

/92 - 0'2 
/32 — ^2 — 0"2 " 





5 7' 
a e 
r, /3 



Now define: 



1^3 



: <5e + 7/3 - 
■ Cf7 + e?7 — 7?j 
: r)(5 + a/J — ad 



One finds: 



aJ2 



(^2 - 
(ai - 



o-l)(/32 - CT2) - (6l - o-2)(fe2 - 
0"2)(b2 - CTi) - (qi - o-i){/32 
o-i)(6l - CT2) - {a2 - cr2)(/3i 



^ 0-2) 

"<xi), 



(40) 



(41) 
(42) 
(43) 

(44) 
(45) 
(46) 



It can be sliown ( [Stadler and Schuster[ |1990[ l that tiiere exists a fixed point in tfie 
interi or of 52, iff all i = 1, . . . , 3 have the same sign, sgncj; = 17 jStadler and Schuster] 
1990 I. Its coordinates are given by x* = (oji, a;2, '•^a)^/'^- The stability of x* is determined 
by the determinant A = a/S-y + 5er], that is: 

A = {ai - o-i)(6i - (T2)(/32 - 0-2) + {02 - o-2)(f'2 - o-i)(^i - 0-1) 

- (^1 - o-i)(/32 - cr2)(oi - 0-1 + 02 - 0-2). (47) 

The interior fixed point is stable iff both eigenvalues of the Jacobian, \if2 = —U{A it 

\/ A'^ — 4uJiL02^^3) , have negative real parts. This requires that sgn zi > 0, and U > 0. Hence 
all uii need to be positive. 

These conditions simplify for the tumor strategies defined in Eq. |30| These imply ai — 
(Ti = — 1, and ft — fTi = 1, j = 1, . . . , 3. With the additional assumption 6; = b, i = 1, . . . , 3, 
it follows that 

oji = 1 - (6 - (Ti)(6 - (T2) 
aJ2 = 1 — — ci) 
a;3 = 1 — (fe - 0-2). 



The determinant reads 



Hence the condition sgn A 
(jji to be positive are: 

LJl > <!= 



A = 2- {b- ai) - {b- a2) =LU2+UJ3- (48) 
E is fulfilled if sgnwi = sgn 1^12 = ^- The conditions for each 



CTl + <J2 



(1 - 0-10-2) 



Ld2 > 
Ld3 > 



4^ 
4^ 



fe > 1 + 0-1 
> 1 + 0-2 



(49) 

(50) 
(51) 
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For the parameter values of the tumor strategies Ti considered here, wi < if both uJ2, and 
Ljg are negative. It thus follows that all three ojj are negative, iff 6 > 1 + maxlci, (72}- Then 
the interior fixed point x* is unstable. For the interior fixed point to be stable, all three 
conditions Eq. 33-35 need to be fulfilled. 
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